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Abstract. Spectrahedra are linear sections of the cone of positive semidefinite matrices which, 
as convex bodies, generalize the class of polyhedra. In this paper we investigate the problem of 
recognizing when a spectrahedron is polyhedral. We generalize and strengthen results of Ramana 
(1998) regarding the structure of spectrahedra and we devise a normal form of representations of 
spectrahedra. This normal form is effectively computable and leads to an algorithm for deciding 
polyhedrality. 



1. Introduction 

A polyhedron is the intersection of the convex cone of non-negative vectors ]R>g with an 
affine subspace. By choosing coordinates for the affine subspace, we can abuse notation and 
write 

P'' = {x G M^"^ : bi - af X > for i = 1, 2, . . . , n} 

for some ai , a2 , . . . , a„ G M"'^^ and bi,b2, ■ ■ ■ ,bn G Polyhedra represent the geometry un- 
derlying linear programming [23] and, as a class of convex bodies, enjoy a considerable interest 
throughout pure and applied mathematics. A proper superclass of convex bodies that inherits 
many of the favorable properties of polyhedra is the class of spectrahedra. 

A spectrahedron is the intersection of the convex cone of positive semidefinite matrices 
with an affine subspace. Identifying the affine subspace with M'^^^ we write 

5" = {x G M^-i : ^0 + xiAi + ■■■+ Xd-iAd-i h O} 

where Aq, . . . ,Aii £ M"^" are symmetric matrices. Thus, a spectrahedron is to a semidefinite 
program, what a polyhedron is to a linear program. The associated map A : M'^"^ — t- M"y^" given 
by ^(x) = ^0 + xiAi + • • • + Xd-iAd-i is called a (symmetric) matrix map and a (symmetric) 
matrix A G M"^" is positive semidefinite A ^ if v^Av > for all v G M". Hence, the set of 
points S"' C M'^"^ at which A(x) is positive semidefinite is determined by a quadratic family of 
halfspaces 

v'^A{x)v = v'^AqV + Xiv'^AiV + X2v'^A2V + ••• + X^-lv'^ Ad^iV > 0. 

Spectrahedra and their projections have received considerable attention in combinatorial op- 
timization [15], polynomial optimization [7], and convex algebraic geometry [9]. To see that 
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polyhedra are spectrahedra, observe that a diagonal matrix is positive semidefinite if and only 
if the diagonal is non-negative. Thus, we have 

= {x G M°'"^ : D{x) >z 0} 

where D{x) = Diag(6i — a^x, . . . ,bn — a^x) is a diagonal matrix map. 

It is a theoretically interesting and practically relevant question to recognize when a spectra- 
hedron is a polyhedron. The diagonal embedding of M>q into the cone of positive semidefi- 
nite matrices suggests that a spectrahedron is a polyhedron if ^(x) can be diagonalized, i.e., 
UA{x)U~^ is diagonal for some (orthogonal) matrix U. By basic linear algebra this is possible 
if and only if ^(p) and j4(q) commute for all p, q G M"'""'^. While this is certainly a sufficient 
condition, observe that by Sylvester's law of inertia 5" = |x : LA{'x.)L^ >z 0} for any non- 
singular matrix L and LA{'k)L'^ is in general not commuting. A more serious situation is when 
a polyhedron is redundantly presented as the intersection of a proper 'big' spectrahedron and a 
'small' polyhedron contained in it. 

In this case, the diagonalizability criterion is genuinely lost. 

In this paper we consider the question of algorithmically telling polyhedra from spectrahedra. 
This question was first addressed by Ramana [18] with a focus on the computational complexity. 
Our results regarding the structure of spectrahedra strengthen and generalize those of [18] and 
we present a simple algorithm to test if a spectrahedron 5" = jj; : A{x) ^ 0} is a polyhedron. 
The algorithm we propose consists of two main components: 

(Approximation) Calculate polyhedron S"^ 5 3°" from ^(x), and 
(Containment) Determine whether S"" C S"". 

Finding a fast algorithm is not to be expected: Ramana [18] showed that deciding whether a 
spectrahedron is polyhedral is NP-hard. As detailed later, the 'Containment' step, which is 
coNP-hard by the results in [10], is done by enumerating all vertices/rays of S. This is clearly 
not feasible in practise and we make no claim that our algorithm is suitable for preprocessing 
semidefinite programs. However, as in the case of the 'vertex enumeration problem' for polyhe- 
dra, it is of considerable interest to have a practical algorithm for exploration, experimentation, 
hypothesis testing with spectrahedra. Our motivation arose in exactly this context. We never- 
theless anticipate applications of our algorithm in the area of (combinatorial) optimization in 
particular in connection with semidefinite extended formulations] see, for example, [5, 8]. In 
Section 3 our algorithm is discussed in some detail and illustrated along an example. We close 
with some remarks regarding implementation and the complexity of the approximation step. 

As for the approximation step, note that if there is a point p G 5" with A(p) positive definite, 
then the algebraic boundary^ the closure of dS"" in the Zariski topology, is contained in the van- 
ishing locus of /(x) = det ^(x) ^ 0. Thus, if F C S"^ is a face of codimension one, the unique 
supporting hyperplane is a component of the algebraic boundary of and hence yields a linear 
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factor of /. Therefore, isolating linear factors in / gives rise to a polyhedral approximation S"^ of 
S"". However, factoring a multivariate polynomial is computationally expensive and an alterna- 
tive is the use of numerical algebraic geometry such as Bertini [1] to isolate the codimension one 
components of degree one (possibly with multiplicities). Our approach avoids calculating the 
determinant of the matrix map altogether by pursuing more algebro-geometric considerations. 
Ramana [18] showed that if 5 is a polyhedron, then in particular coordinates A(x) reveals the 
relevant linear factors in block diagonal form. In Section 2 we recall and strengthen Ramana's 
results with very short proofs that highlights the underlying geometry. In particular, our proof 
emphasizes the role played by eigenspaces of the matrix map. From this, we define a normal 
form with stronger properties and we prove that the polyhedral approximation can be obtained 
by essentially computing the joint invariant subspace of two generic points in the image of ^(x). 

Convention. For reasons of clarity and elegance, we will work in a linear instead of an affine 
setting. That is, our main objects are exclusively spectrahedral cones and hence all matrix maps 
are linear maps M"^ — t- M"y^". Clearly, all results can be translated between the linear and affine 
picture. The spectrahedral cone S associated to the prototypical spectrahedron S"* above is 

S = cone{(p,l) GM'^ : peS'^} = {(x, x^) G M'^ : ^^^^(^x) t 0,Xd>0}. 

The affine picture is recovered by intersecting S with the hyperplane = 1. 

Acknowledgements. This paper grew out of a project proposed by the last two authors for 
the class 'Geometry of Convex Optimization' at UC Berkeley, Fall 2010. We would like to thank 
Bernd Sturmfels and the participants of the class for an inspiring environment. 



2. Normal forms and joint invariant subspaces 

Let S" = {x G M'^ : ^(x) ^ O} be a full-dimensional spectrahedral cone. Throughout this 
section, we will assume that A(x.) is of full rank, i.e., that there is a point p G S" with ^(p) >- 0. 
As explained in the next section, this is not a serious restriction. We are interested in the 
codimension one faces of S and how they manifest in the presentation of S given by ^(x). Let 
us recall the characterization of faces of a spectrahedral cone. 

Lemma 2.1 ([16, Thm. 1]). Let S* = |x : vl(x) >z O} be a full-dimensional spectrahedral cone. 
For every face F Q S there is an inclusion-maximal linear subspace Cp C M" such that 

F = {pe S : Cf^ ker.4(p)}. 

For the case of faces of codimension one, this characterization in terms of kernels implies strong 
restrictions on the describing matrix map. 

Theorem 2.2. Let S" = {x : A(x) ^ O} be a full- dimensional spectrahedral cone and let F C S 
be a face of codimension one. Then there is a non-singular matrix M G M*^^" such that 

MA(.)M- = [•*'(''> 

where k > 1 and ^(x) is a supporting linear form such that F = |x G : ^(x) = O}. 



Proof. Let B = (bi, b2, . . . , b^) be a basis of M'^ such that bi G int 5" and b2,...,b^ G F. 
By applying a suitable congruence, we can assume that A(bi) = Id. In light of Lemma 2.1, 
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let = (ui, U2, . . . , u„) G M"^" be an orthonormal basis of M" such that is spanned by 
Un-k+i, . . . , u„ with k = diraCp. It is easily seen that UA{B:x.)U^ is of the form 

"A'(5x) 

xildfc 

Reverting to the original coordinates (x i— )■ B^^x) replaces xi by £(x). □ 

The form of the matrix map as given in the previous Lemma expresses S as the intersection of 
a linear halfspace and a spectrahedral cone S" = {x : A'{x) ^ O}. Repeating the process for S' 
proves 

Corollary 2.3. Let S" = {x : A{x.) ^ O} be a full-dimensional spectrahedral cone. Then there 
is an non-singular matrix M € M"^" such that 

T _ [Q(x) 



MA{x)M 



DM 



where D{x) is a diagonal matrix map of order m > 0. Moreover, if F C S is a face of 
codimension one, then F = {x£ S : Ai(x) = O} for some 1 < i < m. □ 

If is a polyhedral cone then all inclusion-maximal faces have codimension one and hence S is 
determined by -D(x) alone. This recovers Ramana's result. 

Corollary 2.4 ([18, Thm. 1]). Let S be a full- dimensional spectrahedral cone. Then S is 
polyhedral if and only if there is an M £ GL„ (M) such that 

[Q(x) 



D(x) 



MA{x)M'^ 

where D{x) is a diagonal matrix map and S = {x : D(x) ^ O}. 

The following example illustrates the results. 

Example 2.5. The two dimensional spectrahedral cone given by 



□ 



A{x,y) 





"2 




1 


X 


1 


+ y 


1 



y 



is the polyhedral cone generated by ("f), ("^). A congruence that takes A{x, y) to diagonal 
form is given by 

1 

-1 



M 



1 

t 

V2 



which is unique up to left-multiplication with Diag(a, b) and a, 6 S M \ {0}. o 

The example shows that a rationally presented spectrahedron cannot be transformed into (★) 
of Corollary 2.3 in rational arithmetic, an issue that is commonly encountered with semidefinite 
programs. More importantly it shows that the congruence is not necessarily an orthogonal 
transformation. However, this can be remedied under an additional assumption. A matrix map 
^(x) is unital if there is a po G M"' such that A(po) = Id. 

Proposition 2.6. Let A{x) be a unital matrix map. Then there is an orthogonal n x n-matrix 
U such that UA{x)U^ is in the form of Corollary 2.3. 
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Proof. If M is a positive definite matrix, then, by the existence of a Cholesky decomposition, 
there is a matrix L G M"^" such that LML?" = Id„. Moreover, such an L is unique up to 
left multiphcation by an orthogonal matrix element, i.e., if L' also satisfies the condition, then 
{L')~^L is orthogonal. 

Let M be such that MA(x)M^ has the form of Corollary 2.4 and, since Q(po) and -D(po) are 
both positive definite, let Lq and Ljj he respective Cholesky inverses such that Ljy is diagonal. 
Now, 

Ld 



L 



M 



also satisfies the condition of Corollary 2.4 and is a Cholesky inverse for M(po). However, a 
Cholesky inverse for M(po) = Idn is given by L' = Id„ and by the above remark, we have that 
L = {L')^^L is orthogonal. □ 

The benefit of unital matrix maps is that they afford a normal form which can be effectively 
computed. Let us call a matrix map (5(x) proper if there is no non-zero v E M" such that v is 
an eigenvector of Q{p) for every p G M'^. 

Definition 2.7. A unital matrix map ^(x) is in normal form if 

[Q(x) 



^(x) = 

so that Q{x) is proper and D(x) is diagonal. 



DM 



At this point it is tempting to think that the normal form of a unital map can be determined 
by analyzing the eigenstructure of a single (generic) point A{p). The next example shows that 
this unfortunately is not the case. 

Example 2.8. The spectrahedral cone S given by 



A{x,y,t) 



t X y 
X t 

V t 



>- 



is the redundant intersection of the second order cone : t > 0, > + y^} and the 

halfspace t) : t > O}. Thus, 5 is determined by the principal 3 x 3-submatrix Q{x,y,t) 

and we claim that Q(x, y, t) is proper and that A{x, y, t) is already in normal form. To see this, 
note that both (5(1,0,0) and (5(0,1,0) have distinct eigenvalues but non-trivially intersecting 
eigenspaces. For any point {xQ,yo,to), the eigenspace of = A{xo,yo,to) associated to A = to 
is 2-dimensional. Thus, there is no canonical choice of an eigenbasis for Aq which recovers the 
normal form. o 



However, the normal form of a map A(x) is determined by the structure of the joint invariant 
subspace, the largest subspace M C M" on which all elements in the image of A(x) commute. 
As the next result shows, the joint invariant subspace can be determined by considering two 
generic points in the image. 



6 



AVINASH BHARDWAJ, PHILIPP ROSTALSKI, AND RAMAN SANYAL 



Proposition 2.9. Let j4(x) he a unital matrix map and let p, q G be two distinct generic 
points. LetJ\f C M" the smallest suhspace containing all eigenvectors common to j4(p) and A(q). 
Then M is invariant under any matrix in the image of vl(x) and M'^ is the largest invariant 
suhspace on which A(x) restricts to a proper matrix map. 

Proof. Assuming that ^(x) is in normal form, it is sufficient to prove that for generic p and q 
there is no eigenvector common to Q{'p) and Q{cO. The collections V of ordered pairs of matrices 
{A,B) G ^([;;"xn'j2 ^\^}^ common eigenvector is an algebraic variety and hence nowhere dense. 
This can be seen either by elimination (cf. [3, Ch. 3]) on the set of tuples (^4, Aa, -B, Ab, v) where 
V is an eigenvector of A and B with eigenvalue \a and As, respectively. Alternatively, it follows 
directly from Theorem 3.3 below. Since (5(x) is proper, it follows that V restricts to a proper 
subvariety in {(Q(p), Q(q)) : p, q G M^}. □ 



3. The algorithm 

In this section we describe an algorithm for recognizing polyhedrality of a spectrahedral cone 

5 = {x G M'^ : ^(x) h 0} 

where ^(x) is a linear, symmetric matrix map of order n. As already stated in the introduction, 
the algorithm consists of two steps: An 'approximation' step that constructs an outer polyhedral 
approximation S from the matrix map A(x) that coincides with S whenever S is polyhedral. 
This is then verified in the 'containment' step. 

For the approximation step note that if ^(x) is in normal form, then S is presented as the 
intersection of a proper spectrahedron and a polyhedron (both of which can be trivial). 

Proposition 3.1. Let 5 = {x G : j4(x) ^ O} he a full- dimensional spectrahedral cone with 

^^""^ - [ D(x) 

in normal form. Then 5 = {x : -D(x) > O} is a polyhedral cone with S ^ S. □ 

Towards a procedure to bring A{x) into normal form, we need to ensure that S is full-dimensional 
and ^(x) of full rank. Lemma 2.1 implies that faces of the PSD cone are embeddings of lower- 
dimensional PSD cones into subspaces parametrized by kernels. Recall that the linear hull 
lin(C) of a convex cone C is the intersection of all linear spaces containing C and C is full- 
dimensional relative to lin(C). 

Proposition 3.2 ([16, Cor. 5]). Let S = |x : ^(x) ^ O} he a spectrahedral cone and let 
p G relint S a point in the relative interior. Then the linear hull of S is given by 

lm{S) = {x G M'' : ker A(p) C ker A(x)}. 

If A(x.) is the restriction o/A(x) to (ker ^(p))-*-, then 

5 = {x G lm{S) : i(x) t 0} 



and A{p) >- 0. 
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In concrete terms this means that if M is a basis for the kernel of A{p) at a relative interior 
point p G iS, then lin(S') is the kernel for all points in the image of M>l(x)M"^. The map ^(x) 
is given by MqA{'k)Mq up to a choice of basis Mq for the orthogonal complement of ker A{p). 
Since ^(p) is positive definite, we can choose Mq so that A(p) = Id and hence is unital. This, 
for example, can be achieved by taking advantage of the Cholesky decomposition. By choosing 
a basis B for lin(S'), we identify lin(5) = M*^ for k = dimS which insures that 5" C M'^ is 
full-dimensional. The resulting spectrahedral cone 

S = {zeR'' : A{Bz) h 0} 

is linearly isomorphic to S (via B). 

In actual computations, a point in the relative interior of S may be found by interior point 
algorithms. In case the spectrahedral cone S is strictly feasible, i.e., a point p G M'^ with 
^(p) >- exists, an interior point algorithm finds a point arbitrarily close to the analytic 
center of a suitable dehomogenization of S. Viewed as a linear section of the cone of positive 
semidefinite matrices, S is not strictly feasible, if the linear subspace only meets the boundary 
of {X >z 0}. These are subtle but well-studied cases in which techniques from semidefinite and 
cone programming such as self-dual embeddings [22, Ch. 5], facial reduction [2], or an iterative 
procedure analogous to [11, Remark. 4.15] can be used to obtain a point p G relintS. For the 
purpose of this paper, we will simply follow the first approach as detailed in the implementation 
remarks below. After applying the above procedure and possibly after a change of basis and a 
transformation of the matrix map ^(x) we may assume that the spectrahedral cone is indeed 
full-dimensional and described by a unital matrix map. 

Utilizing Proposition 2.9, we compute the normal form of the unital matrix map A{x.) by deter- 
mining an orthonormal basis for the joint invariant subspace M. The joint invariant subspace is 
given as the smallest subspace containing all eigenvectors common to matrices ^(p) and ^(q) 
for generically chosen p, q G M*^. It can be computed either by pairwise intersecting eigenspaces 
of A(p) and ^(q) or, somewhat more elegantly, by employing the following result followed by a 
diagonalization step. 

Theorem 3.3 ([20, Thm. 3.1]). Let A and B be two symmetric matrices. Then the smallest 
subspace containing all common eigenvectors is given by 

n-l 

J\f = f~] kei [A\B^]. 
where [A,B] = AB — BA is the commutator. 

These techniques originate from the theory of finite dimensional C*-algebras and have been used 
in block-diagonalizations of semidefinite programs; see [4, 14]. After all (n — 1)^ commutators 
have been computed, the intersection of their kernels can be computed effectively by means of 
simple linear algebra. By Proposition 2.9, the restriction of ^(x) to A/" is a map of pairwise 
commuting matrices, there is an orthogonal transformation M such that 

MA{x)M'^ = 



Q(x) 

Z)(x) 
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has the desired normal form with Q{x) proper and -D(x) diagonal. The outer polyhedral ap- 
proximation of S obtained from A(x) is given by 

S = {x G M*^ : i?(x) > 0}. 

It remains to check that SOS. While deciding containment of general (spectrahedral) cones is 
difficult, we exploit here the finite generation of polyhedral cones. 

Theorem 3.4 ([23, Thm. 1.3]). For every polyhedral cone C there is a finite set R = R{C) C C 
such that 

C = j ^ Arr : Ar > /or a// r e 

Thus, if R{S) C 5, we infer that S Q S Q S and hence S is polyhedral. Let us remark that 
computationally expensive polyhedral computations may be avoided by inspecting the lineality 
spaces of S and S first. The lineality space of S, i.e. the largest linear subspaces contained 
in S, is given by by the kernel of the linear map A{x). The complete procedure is given in 
Algorithm 1. As a certificate the algorithm returns the collection of generators R{S). As we 
assume that ^(x) is in normal form, is can be easily checked if S is polyhedral or not. 

Algorithm 1 Recognizing polyhedrality of a spectrahedral cone 

Input: Spectrahedral cone 5 = {x S M'^ : ^(x) ^ O} given by symmetric matrix map ^(x). 
1: Generate point a S M"^ in the relative interior of S. 

2: Compute unital matrix map A{z) of order m and linear isomorphism B such that 

S = {Bt. : A{z) t 0}. 

3: Determine the joint invariant subspace Af = Clijli ^^r [^(p)*, A(q)-'] for two generic points 
p,q G M.''. 

4: Compute an orthonormal basis U corresponding to the decomposition M'^ = M'^ © M and 
compute 



D'{z) 



UA{z)U' 

5: Obtain diagonal map D{z) = VD'{z)V^ via an orthogonal eigenbasis of D'{r). 
6: Compute the extreme rays R = R{S) of the polyhedral cone 

S = {z G M'^' : D{z)ii > for alH = 1, . . . , dimA/"} 
7: S is polyhedral if and only if Q{v) ^0 for all r G i?. 



Implementation details. The algorithm is implemented in Matlab using the free optimiza- 
tion package Yalmip [13] and is available as part of the convex algebraic geometry toolbox 
Bermeja [19]. The SDP solver chosen for the computation of an interior point is SeDuMi [21], 
which implements a self dual embedding strategy and is thus guaranteed to find a point in the 
relative interior, even if the spectrahedral cone is not full-dimensional. Extreme rays of S are 
computed using the software cdd/ cddplus [6] . 

In order to illustrate the algorithm, we consider the following example involving a variant of the 
elliptope £2. (also known as the "Samosa"), cf. [12]. 
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Example 3.5. The spectrahedral cone S" = {x G : A(x) ^ 0} with 



A(x) 



4:X4 2xi + 2xi 2xi 2x3 

2x4 + 2xi 2x4 + 2xi X4 + xi X3 + X2 

2X4 X4 + Xi 2X4 + Xi X3 — X2 X3 

X3 — X2 X4 + xi 

2X3 2^3 + X2 X3 X4 



is to be analyzed. Since the spectrahedral cone in context is full-dimensional and ^(x) is of full 
rank, i.e. ^(p) >~ with p = (0,0,0, 1), the algorithm proceeds by first making the matrix map 
unital. This is facilitated by applying the Cholesky inverse, computed at the interior point p. 
The congruence transformation [7, thus obtained yields the unital matrix map ^(z), allowing 
the use of orthogonal transformations thereafter. 

The next step involves separating the invariant subspace from its orthogonal complement. This 
step is carried out using Theorem 3.3, by means of computing all commutator matrices and 
then intersecting their kernel. The following step involves (simultaneous) diagonalization of the 
commuting part of the matrix (here the lower right 2x2 block) in order to arrive at the desired 
normal form. This transformation matrix V may be computed by diagonalizing any generic 
matrix in the image, restricted to the commuting part. The corresponding unital matrix map 



C/^(x)C/^ and its normal form MA(x)M^ with M 



V 



U are depicted below: 




Figure 1. Dehomogenization 5" (at X4 = 1), of the spectrahedral cone S 
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algorithm eventually terminates by confirming existence of a lineality space in the corresponding 
polyhedral cone, even though the initial spectrahedral cone was pointed. This ensures the non- 
polyhedrality of S. Figure 1 shows a dehomogenization (x4 = 1) oi S with its two polyhedral 
facets. 

A word about complexity. Although calculating the joint invariant subspace of a matrix map 
can be done in polynomial time, the transformation to an unital matrix map is more involved. 
The following example, adapted from [17, Example 23], shows that any such procedure may 
involve numbers with doubly-exponential bit complexity. 

Example 3.6. Consider the family of spectrahedral cones 
Si = jxGM'^ 

for i = 0, . . . ,d — 1. The intersection S = Sq D Si ■ ■ ■ D Sd-i is strictly contained in the cone 
{x € M'^^^ : Xi > 2^' xq}. Denote by A(x) the matrix map for S. Now assume that i?(x) is a 
matrix map for S such that B{p) = Id for some p G int S. Then -B(x) = C/L^(x) {UL)'^ where 
L is the Cholesky inverse of ^(p) and U is an orthogonal matrix. Denote by 1 = {QL)i the 
first column of QL. Prom the definition of the Cholesky decomposition we infer that < ||l|p = 
= has doubly-exponential bit complexity and hence for q = (1,0, ... ,0), we have that 
-B(q) = 11"^ has doubly-exponential bit complexity. o 



Xi+l 

'2xi 



2xi 

Xq 



>- 



x e 



pd+l 



Xo 



> 



XQXi+l > 4xf 
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